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ABSTRACT 


vThe  practical  problem  of  monitoring  air  pollutant  concen¬ 
tration  over  a  geographical  area,  or  of  estimating  the  mining 
resources  in  a  region  or  a  field  can  both  be  formulated  as  a 

e<«  «•  e.  r  *•  ' 

problem  of  interpolation  of  random  field.  • 


Given  a  real-valued  random  field  <Z(x),x^ 
problem  is  to  interpolate  Z  over  an  area  A  f 


the  basic 


problem  is  to  interpolate  Z  over  an  area  A  from  measurements 
taken  at  n  stations  x^,x^ , . . . ,x^  ,  when  the  distribution  of 
Z  is  only  partially  specified.  The  second  proble-vi  is  the 
choice  of  the  network  of  stations.  After  deriving  the  .form  of 
the  best  linear  unbiased  predictor  of  Z  we  prove  a  general 
updating  theorem  which  is  useful  both  practically  to  quicken 
the  computation  of  the  new  estimated  map,  and  theoretically  to 
study  the  problem  of  network  design.  Then  we  use  this  theorem 
to  prove  that  when  Z  is  a  '"‘smooth "‘'"random  field  (essentially 
differentiable  in  quadratic  mean)  the  variance  of  estimation 
error  of  Z(x)  is  a  discontinuous  function  of  the  arguments 
x^x^ ,  ...,x^  .  We  discuss  the  practical  consequences  of  this 
result  in  the  design  of  networks  of  stations.  _ 


Key  words :  Best  linear  unbiased  predictor,  random  field, 

covariance  function,  differentiability  in  quadratic 
mean,  network  design. 


1.  Introduction  and  summary: 

The  practical  problem  of  monitoring  air  pollutant  concen¬ 
tration  over  a  geographical  area,  or  of  estimating  the  mining 
resources  in  a  region  or  a  field  can  both  be  formulated  as  a 
problem  of  interpolation  of  a  random  field. 

A  random  field  is  a  real  valued  stochastic  process 
{ Z (x) ,x e  ]Rm}  indexed  in  a  multidimensional  set,  usually  a  two- 
dimensional  spatial  area.  The  problem  considered  here  is  to 
estimate  Z(x)  for  all  xeA  (some  region  of  interest)  from 
observations  Z(x1),  Z(x2 ),...,  Z(xn)  made  at  n  points,  and 
when  the  probability  distribution  of  the  random  field  is  only 
partially  specified.  The  points  x^,x-, , . . .  ,xn  are  called  the 
monitoring  stations. 

After  having  presented  the  model,  which  is  akin  to  a  linear 
regression  nodel  (mean  function  known  up  to  a  vector  of  parameters, 
covariance  function  known)  and  the  method  of  estimation,  in 

A 

Section  2  we  prove  a  useful  updating  theorem:  if  Z(x)  is  the 

estimator  of  Z(x)  based  on  Z (x. ) , Z (x_) , . . . , Z (x  )  and  Z  (x) 

12  n  y 

that  based  on  Z (x^)  ,  Z (x2) , . . . , Z (xn)  and  Z(y)  we  show  that 
Zy(x)  *  Z(x)  +  a[z(y)  -  Z  (y )] 
where  a  has  a  simple  form. 


Then  in  Section  3  we  apply  this  theorem  to  the  problem  of 


2- 


network  design.  It  is  shown  that,  contrary  to  a  common  belief, 
a  network  of  stations  {x^ , Xj / • • • »xn)  where  some  stations  are 
close  to  each  other  does  not  in  general  produce  redundant  infor¬ 
mation.  Specifically 

(1.1)  lim  Var(Z  (x)  -  Z(x) }  <  Var{ Z (x)  -  Z (x) } 
y-xn 

The  most  interesting  condition  under  which  (1.1)  is  true 
is  when  the  covariance  function  (assumed  isotropic)  is  of  the 
form 

2 

(1.2)  K  (h)  «  a2(l  -  —  h2  +  o  (h2) ) 

2 

2 

If  the  covariance  function  is  only  of  the  form  K(h)  -  a  (l-ah  +  o(h)) 

for  a  >  0  ,  then  equality  holds  in  expression  (1) .  Explicit 

formulas  for  lim  Var{Z  (x)  -  Z(x)}  are  given  in  each  case. 
y-xn 

A  stationary  random  field  whose  covariance  function  is  of 
the  form  (1.2)  is  differentiable  in  quadratic  mean.  As  a  conse¬ 
quence  of  the  above  result  it  is  possible  to  improve  the  estima¬ 
tion,  based  on  some  network,  of  a  smooth  random  field  without 
"building"  new  stations  (see  figure  below  showing  the  variance 
of  estimation  of  a  stationary  random  field  with  covariance  func¬ 
tion  K (h)  *  e~6h  ) . 


la 


lb 


Figure  1.  Example  of  improvement  of  a  network  of  six  stations  for 
estimation  of  a  smooth  random  field.  Figure  la  represents  the  level 
curves  of  the  function  Var(Z(x)  -  Z(x))  in  the  standard  use  of  the 


network;  figure  lb  shows  the  improvement  realized  by  taking  three 
measurements  close  to  each  other  instead  of  one  at  a  single  station. 
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The  method  that  we  use  to  estimate  (or  "interpolate",  or  "predict") 
Z(x)  is  the  classical  best  linear  unbiased  prediction.  A  simple 
concise  presentation  of  it  is  given  by  Goldberger  (1962) .  This 
method  has  also  been  extensively  applied,  and  given  some  new 
theoretical  developments,  by  Matheron  and  his  colleagues.  They 
dubbed  their  whole  body  of  techniques  Kriging,  see  Delfiner  (1975) 
and  further  references  given  there. 

In  another  paper  (Cabannes  1979  b)  ,  meant  to  parallel  the 
present  one,  the  author  shows  some  optimal  statistical  properties 
of  best  linear  unbiased  predictors. 

2.  The  model;  the  best  linear  unbiased  predictor;  and  an  updating 
theorem : 

Given  the  random  field  {Z(x),  x  €  ]Rm}  we  want  to  estimate 
Z(x)  ,  at  some  fixed  point  x  ,  from  the  observations  Z ( x1 ) , Z (x2) >  • • • 
Z(xn) .  To  do  that  we  assume  the  following  model: 

1)  The  random  field  has  a  covariance  function  K(x,y)  = 
cov (Z (x) , Z (y) )  which  is  entirely  specified.  That  is  to  say,  in 
practice,  it  is  known  to  us. 

2)  The  mean  function  m(x)  =  EZ(x)  is  only  partially  specified 
We  make  the  assumption  that  it  is  of  the  form 

m(x)  =  a-^fx)  +  a2f2(x)  +...+  a  f  (x) 
where  p  and  the  functions  f^ (x) ,f 2 (x) , . . . , f  (x)  are  known  to 


us,  while  the  parameters  ai'a2'***'ap  are  unlcnown*  The  follow 
ing  examples  will  make  this  assumption  clear: 

a)  assume  that  the  mean  function  is  an  unknown  constant  m 
This  corresponds  to  p=l,  f^(x)  =  1,  a^  =  m. 

2 

b)  in  a  two-dimensional  random  field  {Z(x)  ,x  el  }  assume 
the  mean  function  is  an  unknown  plane.  If  we  denote  by  u(x) 
and  v(x)  the  components  of  the  point  x  ,  this  corresponds  to 
p  =  3,  f^ (x)  =  1,  f 2 (x)  =  u(x)  and  f 3  (x)  =  v(x)  ,  while 
a^,a2,a3  are  the  coefficients  of  the  plane. 

The  method  of  estimation  that  we  choose  is  the  best  linear 
unbiased  prediction.  That  is,  we  will  use  the  estimator  Z(x) 
such  that 

1)  Z(x)  *  X1(x)Z(x1)  +  X2(x)Z(x2)  +  .  . .  Xn  (x)  Z  (xn) 

A 

2)  E  Z (x)  =  m (x)  for  all  values  of  the  parameters  a^ ' s . 

y.  2 

3)  E{Z(x)-Z(x)}  is  minimum. 


Note:  the  third  requirement  is  meaningful  because  an  estimator 
satisfying  conditions  (1)  and  (2)  is  necessarily  such  that  its 
mean  squared  error  does  not  depend  on  the  a^'s. 

We  adopt  the  following  condensed  notation : 


z(*i>  \ 

Z(x2) 


the  network  observations 
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K  3  covariance  matrix  of  Z 


3  covariance  vector  between  Z(x)  and  Z 


f x  =  (fx(x) ,  f2(x) f  (x>) 


a  3  (a^aj, . . .  ,ap)  so  that  m(x)  3  fx  a 


f^x^ 


F  = 


yv 


Lfi(xn)  f2(xn) 


fp(xn} 


thus  EZ  =  F  a 


X  3  (Xx (x) ,X2 (x) , . . . , Xn (x) ) 


The  calculations  leading  to  the  best  linear  unbiased  pre¬ 
dictor  are  classical  (see  Goldberger  (1962) ,  for  instance) .  The 
optimal  X  is 


(2.1)  X  3  K_1k  -  k"1f' (FK_1f' )"1FK"1k  + K*1F ' (FK_1F ' ) _1 f 

X  XX 


and  the  mean  squared  error  using  the  B.L.U.E.  is 


(2.2) 


Var  (Z (x)  -  Z (x) )  3  K (x , x)  -  kx ' K"1kx 

+  (FK_1kx-  fx)  '  (FK_1F '  )  _1  (FK_1kx  -  t^) 
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To  the  above  list  we  add  the  following  notation: 


G  =  FK_1F ' 


4>  =  FK_1k  -  f 

x  xx 


Goldberger  made  the  observation  that  the  B.L.U.E.  of  Z(x) 
can  be  rewritten 


i  a  i  -1  r  »  ^  i 

Z(x)  =  f  a  +  k  K  Llz  -  Fa] 

X  X  " 


/v  _1  -1 

where  a  =  G  FK  Z  is  the  generalized  least  square  estimator 
of  a  using  Z.  For  further  explanations  on  the  natural  form 

A 

of  Z(x)  see  Cabannes  (1979  a)  . 


Theorem  2.1:  (Updating  theorem) 


Let  Zy(x)  be  the  B.L.U.E.  of  Z(x)  based  on  the  augmented 
set  of  observations  Z (x. ) , Z (x.) , . . . , Z (x  )  and  Z(y).  Then 
Zy(x)  and  Z(x)  (which  is  the  B.L.U.E.  based  on  Z)  are  related 
as  follows: 


(2.3)  2  (x)  =  2  (x)  -  [2  (y)  -  2(y)] 


Var (Z (y)  -  Z(y) ) 


Var (Z„ (x)  -  Z(x) ) 


Var (Z (x)  -  Z(x) ) 


*  1  -  P  (x,y) 


where  p  (x,y)  =  corr(Z{x)  -  Z(x),Z(y)  -  Z(y)) 


Proof 


(*) 


Since 


Z  (x) 

y 


is  a  linear  function  of 

/V  /V 


Z  (Xj,)  ,  Z  (x2)  /  •  •  •  #  Z  (xn)  ,  Z  (y)  while  Z  (x)  and  Z(y)  are 
functions  only  of  Z (x^) , Z (x2) » . • . ,Z (x  ) ,  we  can  write 


linear 


Zy(x)  -  Z(x)  =  a  [z  (y)  -  Z(y)]  +  61Z(x1)  +  82Z(x2)  +  . ..+SnZ(xn) 
=  a [z  (y)  -  Z  (y)]  +  $'  Z 


where  the  coefficients  a  and  (5^,62,...,B  depend  on 
x1,x2,...,xn  ,  x  and  y  . 

The  first  objective  is  to  show  that  6  Z  =  0.  Since 
EZy(x)  =  E  Z  (x)  and  EZ(y)  =  E  Z  (y)  ,  we  deduce  that  Eg'z  =  0. 

Next  suppose  that  cov(Z(x)  -  Z(x),  $'z)  -  c  ?  0  ,  then  we 
can  construct  a  linear  unbiased  estimator  of  Z(x)  which  is 
better  than  the  B.L.U.E.  Indeed  consider  Z(x)  +  ys'z,  :  it  is 
linear,  unbiased  and 


Var  (S  (x)  +  ys'z  -  Z(x) )  = 

Var(Z(x)  -  Z(x))  +  2yc  +  y2Vars'z_ 

hence  the  choice  y  - £-t —  makes 

VarB  Z 

Var(Z(x)  +  y3'z_-  Z{x))  <  Var(Z(x)  -  Z(x)).  This  is  a  contra¬ 
diction.  Therefore  0'_Z  is  uncorrelated  with  Z(x)  -  o(x)  . 

i*)  " 

I  am  grateful  to  Yi-Chmg  Yao  for  this  proof  which  simplifies 
my  original  one  using  partitioned  matrices. 


The  same  argument  shows  that  S' 2  is  uncorrelated  with 

A  A 

Z(x)  -  Z(x)  ,  and  also  with  Z(y)  -  Z(y).  From  this  it  is  easy 
to  conclude  that  VarS’Z  =  0  .  This  is  done  as  follows: 

note  that  3'Z  =  Zy(x)  -  Z(x)  -  a[Z(y)  -  Z(y)]  = 

Zy(x)  -  Z  (x)  -  [  Z  (x)  -  Z  ( x )  ]  -  a  [z  (y )  -  Z  (y)]  ;  hence,  from 
Var8'£  =  cov(8'Z,  3'Z)  ,  substituting  the  above  expression  for 

one  of  the  2'Z  ,  we  get  Var  S'Z.  =  0  .  From  this  we  conclude 
that  S’Z  =  0. 

It  remains  to  show  that  the  coefficient  ct  has  the  form, 
given  in  formula  (2.3).  Since  B*  Z  =  0  we  can  write 

2  (x)  -  Z(X)  -  [z  (x)  -  Z(x)]  =  a[z(y)  -  Z(y)] 

A 

take  on  both  sides  the  covariance  with  Z(y)  -  Z(y),  and  note  that, 
for  the  same  reasons  as  above,  Zy(x)  -  Z(x)  is  uncorrelated  with 
Z  (y )  -  Z (y) .  This  yields  -  cov (Z (y)-Z(y),  Z (x)  -  Z (x) )  = 

A 

a  Var  (Z(y)  -Z(y))  and  establishes  formula  (2.3). 

To  prove  formula  (2.4)  write 

Z  (x)  -  Z  (x)  =  Z  (x)  -  Z  (x)  +  a[z  (y)  -  Z  (y )] 

and  take  variances  on  both  sides.  This  gives 

Var (Zy (x)  -  Z (x) )  =  Var(Z(x)  -  Z(x)) 

+  a2Var (Z (y)  -  Z (y) ) 

+  2acov (Z (x)  -  Z (x) ,  Z (y)  -  Z (y) ) 


and  using  the  expression  obtained  for  a  we  get 
Var(Zy(x)  -  Z  (x)  )  =  Var(Z(x)  -  Z(x))  [l  -  p2(x,y)]  where 
c2(x,y)  =  corr ( Z (x)  -  Z(x),  Z(y)  -  Z(y)) 

Q  .  E  •  D  . 

This  updating  theorem  is  very  useful  to  compute  the  new 
estimated  map  (Z  (x),  x=A}  from  the  already  computed  values 
{Z(x),  xsA)  .  We  refer  the  reader  to  Cabannes  (1979a)  for  details 
and  an  illustration  of  this  point.  The  theorem  is  also  useful 
to  study  theoretically  the  problem  of  network  design. 

In  Section  3,  to  apply  theorem  2.1  it  is  convenient  to  have 
for  the  coefficient  a  a  more  explicit  form.  We  already  have 
the  explicit  expression 

Var  ( Z  (y )  -  Z  (y)  )  »  K(y,y)  -  k^K*1^  +  *y'G_1- 

given  (slightly  differently)  by  formula  (2.2).  The  next  theorem 
gives  an  analogous  expression  for  the  covariance  term  in  the 
coefficient  a  : 

Theorem  2 . 2 

(2.5)  Cov (Z (x)  -  Z (x) ,  Z (y)  -  Z (y) )  =  K (x,y)  -  kx'K_1ky  +  ?x'G~15y 

proof :  From  formula  (2.1)  for  the  vector  of  coefficients  X  in 

A 

Z(x),  we  can  write 

Z  (x)  =  k  'K~1Z  -  <b  ’g"1FK~1Z 

x  —  X  — 
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then  cov(Z{x)  -  Z(x),  Z(y)  -  Z(y)) 

=  cov (Z (x) ,  Z  (y) )  -  cov(Z(x),  Z(y)) 

-  cov ( Z ( x) /  Z(y))  +  cov(Z(x),  Z(y)) 

=  (k  '  -  <i>  '  G~^FK_1)  K  (K~1k  -  K-1F  '  ) 

x  x  y  y 

-  X' (y)kx  -  X* (x)ky  +  K(x,y) 

after  developing  and  cancelling  terms  in  this  expression  we 
obtain  formula  (2.5) 

Q*  £  ■  D* 


3.  Application  to  study  of  continuity  of  Var(Z(x)  -  Z(x))  and 
to  network  design: 

In  this  section  we  apply  theorem  2.1  to  the  study  of  what 
happens  when  two  or  more  monitoring  stations  of  the  network  are 
close  to  each  other.  And  we  show  that  interesting  results  occur 
when  the  random  field  Z  is  smooth  in  a  stochastic  sense. 

In  order  to  be  able  to  state  results  with  simple  formulas 
we  will  specialize  to  an  isotropic  covariance  function:  the 
function  K(x,y)  will  only  depend  on  ||y-x  ||  . 

The  hinge  of  the  next  theorem  is  that  an  isotropic  random 
field  (Z(x),  x =  ]Rm}  is  differentiable  in  quadratic  mean  if 
and  only  if  its  covariance  function  is  of  the  form 
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K(x,y)  *  o2^l  -  || x  -y  ||2  +  o(||x-y||2)J  .  This  result  still 

holds  if  Z  has  a  differentiable  non  constant  mean  function  and 
an  isotropic  covariance  function. 

For  convenience  we  introduce  the  following  notation: 
s (x;x1,x2/ • • • ,xn)  =  Var(Z(x)  -  Z(x))  where  Z(x)  is  based 
on  the  network  x^,x2,...,xn  .  Consequently,  according  to  the 
definition  in  Section  2, 

s(x;x1,x2,...,xn,y)  =  Var(Zy(x)  -  Z(x)) 


Theorem  3.1:  If  a  random  field  {Z(x),xe!Rm}  ,  with  differentiable 
mean  function  and  isotropic  covariance  function,  is  differentiable 
in  quadratic  mean,  then  the  function  s (x;x1,x2, . . . ,x  ,y)  is  not 
continuous  in  y  ,  in  the  sense  that 


lim  s (x;  x.,  x«, . . . ,  x  , y)  ^  s(x;  x.  ,  x.,...,  x  ) 

y  -►  ±  ii  ±  £  n 


Indeed,  we  have 


(3.1) 


lim 
y  x 


s  (x  t  x^ ,  x2 f 


.  *n.y) 


n 


s(x;  x^,  x2,. 


(with  fixed  direction) 


**'  xn} 


=  1  -  p*2 


with 


(3.2) 


w’  (xn  -  y) 


[(xn  -  y)  'A(xn  -  y)]  1/2 


where  <  is  a  constant,  w  is  a  vector,  and  A  is  a  positive 
definite  quadratic  form,  each  depending  only  on  x,x^,  x2» • • . ,  xn  . 
In  the  case  n  =  1  ,  formula  (3.2)  simplifies  to 


(3.3) 


>*  = 


<  cos (y  x  x) 


n 


where  y  x  x  is  the  angle  between  the  directions  of  y  -  x  and 
J  n  3  n 

x-xn  - 

If  the  random  field  is  not  differentiable  but  continuous  in 

2 

quadratic  mean  and  K(h)  =  a  (1  -  ah+o(h))  ,  a  >  0,  then 
s(x;  x. ,  x2,...,  *n,y)  is  continuous  in  y  in  the  sense  indi¬ 
cated  above. 

Finally,  if  the  random  field  is  not  continuous  in  q.m. ,  then 
again  the  function  s  (x;  x^,  x2/-**/  xn,y)  not  continuous 

in  y  . 

Proof.  If  the  random  field,  with  differentiable  mean  function 
and  isotropic  covariance  function,  is  differentiable  then 

2 

K(x,y)  =  a2(l-  —  |  [  x  -  y  1 1  2  +  o  ( ||  x  -  y  ||  2) )  . 

2 

With  no  loss  of  generality,  let's  take  a  =  1  . 

In  theorem  2.1  we  proved  that 


(3.4) 


s (x;  x  ^ ,  x 2 » • • *  ,  x^ , y ) 
s(x;  x^  x2/...,  xn) 


1  -  p2(x,y) 


where 
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(3.5)  p(x.y)  -  e°v(zm)-g(x)fz<y)-»<y>) - -  , 

[var ( Z  (x)  -  Z (x) ) Var ( Z  (y )  -  Z(y))]1/2 

Z  being  computed  on  the  basis  of  x^,  x2'‘**'xn  •  To  prove 
theorem  3.1  we  shall  derive  the  expansion  of  p(x,y),  when 
y  -*■  xn  ,  by  computing  those  of 

(3.6)  Var  (Z  (y )  -  Z  (y ) )  =  1  -  ^K-1k  + 

and 

(3.7)  Cov(Z  (x)  -  Z  (x)  ,Z(y)  -  Z(y) )  =  K (x,y)  -  k^K_1ky  +  . 

We  need  a  Taylor  expansion  of  K(x,y)  when  y -►  xR  .  To  do 
this  it  will  be  convenient  to  use  for  K(x,y)  the  form 

a2  ? 

(3.8)  K(x,y)  =  R  (  ~  !!  x  -  y  1 1  ) 

So  we  have  R(t)  =  l-t  +  o(t)  as  t  4-  0  .  Next  note  that 

(3.9)  l|x-y||2  =  II  x  -  xn  1 1  2  +  2(x-xn)'(xn-y)  +  ||xn-y||2  , 

hence 

R(y  II  x  -  y  ||  2  =  R(^||x-xn||2)  + 

2  2 
V  [2(x-xn)  1  (xn-y)  +  Hxn-y||2]RW  («_  ||x-xn  ||  2)  + 

°  ( il  xn-y  || )  , 
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(Rl  j  denotes  the  first  derivative  of  the  function  R) .  From 
(3.8)  we  conclude  that  for  all  x 


(3.10)  K(x,y)  *  K(x,xn)  +  a2  (x-xn)  '  (xn-y)R^  (^-  ||x-xn  ||  2)  +  o  ( ||xn~y  ||  )  , 
while  for  x_ 


(3.11)  K(xn,y)  *  1  -  a-||xn-y!|2  +  o(||xn-y||2) 


First  we  apply  (3.10)  and  (3.11)  to 


ky  ’ 


K(x1,y) 


Klxn-l,y) 


K(xn,y) 


With  the  following  notation 


(xrxn) '  rC11  (V"xrxn*'Z) 


(3.12)  Q  —  a  ,  r | i  .2  2 

<xn-l-xn>  R  (T- > 

-7<xn-r> ' 


°  <  li  xn~y  I! ) 


(3.13) 


°  ( II  xn~y  II ) 

O  ( 11  xn-y  II  2 ) 
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we  can  write 

(3.14)  k  =  k  +  JJ(x  -y)  +  £ 

y  xn 

Secondly,  applying  (3.14)  to  $  =  F K  ^k^  -  f  we  obtain 


♦ 


y 


(3.15) 


F  K_1k  +  F  K_1Q  (x  -  y )  +  F  K_1£  -  f 
xn  y 

f  +  F  K_1n  (x  -  y)  +  F  K~ 1  £  -  f 
xn  y 

(FK_1fi  +  fM,  (xn-y)  +  n 


where  f ,  =  [grad  f  ]  ,  and  n  is  a  p-dimensional  vector, 

x  y  y  x 

n  n 

each  component  of  which  is  o  ( 1 1  xn — y  1 1 )  . 

With  these  preliminaries,  now  we  can  compute  the  variance 
and  covariance  given  in  (3.6)  and  (3.7).  Using  (3.14)  and  (3.15) 
we  obtain,  on  the  first  hand, 


Var  (Z  (y)  -Z  (y) )  =  1  -  (k  +  fl  (x-y)  +e)  '  k'1  (k  +  n(x-y)+e) 

xn  n  xn 


(3.16) 


+  [(FK_1a  +  fxW  )  (xn-y)+n],G"1  [(F  k’1^  +  fx^^)  (Xn-y)+n] 


i  l  * 

Since  k^  K_ik„  =  1,  k^  k“  Q,  «  -  (xR-y)  ’  and 


X„  X„ 

n  n 


n 


k'  K~^£  *  o  ( I!  x  -y  |j  *)  ,  the  R.H.S.  of  (3.16)  becomes 
xn  n  . 


a^||xn-y||z  -  (xn-y),Q’K'1fi(xn-y)  +  o(||xn-y||‘>  + 


(3.17) 


(xn-y),[FK“1n+fW],G‘1[FK"1«  +  f  W  ]  (xn-y )  -ho  ( ||  xn-y  ||  2 ) 


'-•.rrr 
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or  in  condensed  notation 


(3.18) 


(xn-y) ’A(xn-y)  +  o  ( li xn~y  I!  ) 


where  A  (which  depends  only  on  x^,x2,...,xn  and  x)  is  a 
positive  definite  quadratic  form  since  (3.18)  is  the  expansion 
of  a  variance.  On  the  other  hand,  we  have 


Cov  (Z(x)-Z(x) ,  Z  (y)  -  Z  (y) )  =  K(x,y)  -  k^K“1(kx  +Q(xn~y)  +e)  + 

n 


(3.19) 


(PK“1n+f  1  )  (xn-y)  +  n 
n 


Using  (3.10)  and  k’K~1kv  =  K>(x,x )  ,  the  R.H.S.  of  (3.19) 

n 

simplifies  to 


L 


i2(x-xn)  '  (xn-y)R^1-^  (^-  i|x-xn||2)  +o(||xn-y||)  - 


(3.20) 


k'K~1n(x  -y)  -  k ' K'*1e  + 


<j>xG"1[F  K-1G  +  f  M  ]  (xn-y)  + 


or  in  condensed  notation 


(3.21) 


w'  (xn-y)  +  o(  ||xn-y  || )  . 


where  w  is  a  vector  depending  only  on  x1,x2,...,xn  and  x 
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Now  substituting  (3.18)  and  (3.21)  in  formula  (3.5)  we  obtain 


(3.22)  p(x,y) 


w*  (xn-y)  +  o(||xn-y||  ) 

(Var(Z(x)-Z(x) )  [(xn~y)  'A(xn-y)  +  o  ( ||  xn-y  ||  2)]  }1/2 


The  first  part  of  the  theorem,  i.e.,  formula  (3.2),  follows 
from  (3.22)  when  we  let  y  tend  to  x 

n 

In  the  case  n  =  1,  to  establish  the  more  explicit  formula 
(3.3),  we  must  go  back  to  formulas  (3.17)  and  (3.20).  Observe 
that  in  this  case 


a)  ft  =  -  a2  (xn~y)  ' 

b)  F  =  1  and  fW  ■  0. 

xn 

c)  K,  G,  K  1  ,  and  G-1  are  equal  to  1, 
hence  (3.17)  becomes 

(3.23)  Var  (Z  (y)  -  Z  (y) )  *  a2||xn-y||2  +  o(||xn-y||2) 

and  (3.20)  becomes 


(3.24)  Cov ( Z (x)  -  Z (x) , Z  (y )  -  Z (y) )  = 


a2(x-xn)  '  (xn-y)RW  (*_  [jx-xjl2)  +  o(||xn-y||) 
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Since  we  have 

[a2||xn-y!|2  +  o  ( I!  xn-y  |{  2 )  ]  1/2  =  a||xn-y  ||  +  o(  ||xn~y  || ) 


from  (3.23)  and  (3.24),  we  conclude  that 


P (x,y) 


< 


(x-xn) ' (y-xn) 
|x-xn||  II y-xn || 


+  o(|jxn-y||  ) 


where  k  is  a  scalar  independent  of  y  .  This  completes  the 
proof  of  formula  (3.3) 

Some  more  calculations,  that  we  omit,  show  that  in  the  case 
n  =  1  the  constant  <  is  actually  equal  to 


2 

a||x-xn||  RM(VHx-xn||2> 
[2(l-R(^||x-xn||2))]  1/2 


_d_ 

du 


[(1  -  R(u2)  )  1/2 


f 


where 


u  =  — -  ||x-xn| 
✓7  n 


We  now  consider  the  case  when  the  random  field  is  not  differ¬ 
entiable  but  continuous  in  q.m.  and  K(h)  =  1  -  ah  +  o(h),  with 
a>0  .  To  establish  the  continuity  of  s(x;  x^,x2, . • . ,xn,y)  we 
use  the  same  scheme  as  before.  The  important  difference  is  that 
||  x— y  1 1  plays  the  role  of  ||x-y(|  and  formula  (3.9)  is  replaced  by 


i 


iiii 
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x-y||  *  [||x-xnir  +  2  (x-xn)  '  (xn-y)  +  ||xn-y|r] 


2t  1/2 


2  il  1/2 


2(x-x  )’(x-y)  1 1  x  —  y  1 1  ] 

|!x-xj|  1+  - 2 - “ -  +  —2 -  J 

n  l|x-xnH2  ||x-Xn||2 


( x— x  )  1  (x  -y) 

l*-xnH  1  +  rj -  +  o(l|x  -ylll 

l|x-xnl| 


( x— x  ) '  (x  -y) 

*  + — 7, - [1 — +°<IUn-y|l>  • 

i|x-xn|| 


Formulas  (3.10)  and  (3.11)  become  the  following:  For  all  x 


X  )  *  (x  ~y J  r*  ^ 

(3.26)  K(x,y)  *  K(x,x)  +  a  - - - - -  R  W  (a  ||  x-xn  || )  +  o  ( ||  x  -y  || ) 

n  ||x-xl|  n  n 


while  for  x. 


K(xn,y)  =  1  -  a||xn-y)|  +  o(||xn-y||)  . 


To  express  k^  we  use  the  new  notation 


rW  (a||x1-xn|| ) 

r  -X  )  ' - 

1  °  II  II 


(3.28) 


^xn-l-xn^ ' 


Rl  J  (a||xn_1-xnli) 

l!xn-rxnll 


(xn-y>' 

l|xn-y|| 


20- 


and 

°  ( II  xn“Y  li 

o  ( |!  xn-y  |  j  ) 
o(||xn-y||) 

The  difference  between  e  given  by  (3.13)  and  given  by  (3.29) 

is  that  the  last  component  of  is  o(||xn-y||)  instead  of  being 

o(  ||xn-y  ||2)  . 

Formulas  (3.14)  and  (3.15)  still  hold  with  and 

substituting  for  fi  and  e.  But  the  calculations  made  in  (3.16), 
(3.17),  and  (3.18)  are  replaced  by 

(3.30)  Var  (2  (y)  -  Z(y))  =  a||xn-y||  +  o(||xn-y||). 

On  the  other  hand,  formula  (3.21),  giving  the  development  of 
Cov(Z(x)  -  Z(x),Z(y)  -  Z(y))  is  still  true.  Therefore 

Cov(Z(x)  -  Z  (x)  ,$  (y)  -  Z  (y )  )  =  0(||xn-y||)  , 

whereas,  from  (3.30) 


[var  (Z  (y)  -  Z(y))]1/2  =  0  ( |j  xR-y  || 1/2 )  . 


We  conclude  that 
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lim  p(x,y)  =  0  , 

lly-xnll  0 

and  this,  in  view  of  (3.4),  establishes  the  continuity  of 
s (x;  x1,x2, • • . ,xn,y)  . 

Lastly,  when  the  random  field  is  not  continuous  in  quadratic 
mean,  the  covariance  function  K(h)  is  not  continuous  at  the 
origin.  Then  neither  Cov(Z(x)  -  Z(x),Z(y)  -  Z(y))  nor 
Var(Z(y)  -  Z(y))  tend  to  zero  when  ||y-xn||  tends  to  zero. 

Hence  p(x,y)/>*  0  and  s  is  not  continuous.  Q.E.D. 

We  now  conclude  this  section  with  a  discussion  of  the  inter¬ 
pretation  of  the  theorem  just  proved,  and  a  discussion  of  the  con¬ 
sequences  for  network  design.  Consider  for  simplicity  a  two-di- 

2 

mensional  random  field  {  Z  (x)  ,  x  €  TR  } 

Before  interpreting  the  theorem  just  proved,  we  observe  that 
expressions  (3.17)  and  (3.20)  are  often  well  approximated  by  ex¬ 
pressions  (3.23)  and  (3.24).  As  a  consequence,  the  formula 

p *  =  <  cos  (yl^x) 

is  an  approximation,  even  when  n  >  1,  to  the  more  complicated 

formula  (3.2)  which  enters  expression  (3.1),  giving  the  reduction 

of  uncertainty  at  x  when  a  station  y  is  added  in  the  vicinity 

of  x„  . 
n 

The  interpretation  of  Theorem  3.1  is  that  when  station  y  is 
very  close  to  xR  three  possibilities  can  arise: 

1.  K(h)  has  a  jump  at  the  origin  and  Z  can  be  decomposed 


into  two  parts 


Z  =  ;  +  £  , 

where  c  is  a  random  field  with  isotropic  covariance  function 

continuous  at  the  origin,  and  e  is  an  independent  stationary  white 

noise.  Then  the  couple  (Z(y),  Z(xn)}  provides  information  on 

the  variance  of  e  that  Z(x  )  alone  does  not  provide. 

n 

2.  K(h)  =  1  -  ah  +  o(h),  z  is  continuous  in  q.m.  but  not 

differentiable.  Then  Z(y)  and  Z(xn),  in  the  limit,  measure 

the  same  thing  and  do  not  provide  more  information  than  Z(x  )  alone. 

2  n 

3.  However,  if  K(h)  =  1  -  ~  h^  +  o(h^),  Z  is  differentiable, 
and  then  (Z(y),  Z(xn)}  provides  information  on  the  partial  deri¬ 
vative  of  Z  at  x  in  the  direction  of  y  -  x  .  In  the  case 

n  =  1  the  reduction  of  uncertainty  about  Z(x)  at  any  x  is 
proportional  to  the  square  of  the  cosine  of  the  angle  between 
y  -  x^  and  x  -  x^  . 

The  three  cases  considered  above  do  not  exhaust  the  possible 

2 

forms  of  isotropic  covariance  functions  in  3R  .  However,  the 

cases  left  over  are  pathological  cases  such  as,  for  instance,  a 

function  K(h)  for  which  lim  sup  K(h)  ?  lim  inf  K(h) 

h  -*■  0  h  -*•  0 

or,  an  isotropic  covariance  function  continous  but  not  differentiable 
at  the  origin.  Such  covariance  functions  are  not  used  in  prac¬ 
tice. 

The  preceding  interpretation  can  be  given  the  following  ex¬ 
tension,  that  we  have  not  proved:  When  the  random  field  Z  is 
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dif ferentiable  in  quadratic  mean,  three  measurements 
{Z(x  ),  Zly^,  Z(y2)}  /  where  y.^  and  y2  are  very  close  to 
x„  ,  and  the  directions  of  y.  -  x„  and  y_  -  x  are  different, 
for  instance  perpendicular,  will  provide  all  possible  information 
on  the  first-order  partial  derivatives  of  Z  at  x  .  They  will 
determine  the  tangent  plane.  Moreover,  in  the  limit  the  reduction 
of  uncertainty  on  Z(x)  at  any  point  x  will  be  independent  of 

the  directions  y.  -  x  ,  y~  -  x  ,  orovided  they  are  not  the  same. 

1  n  2.  n 

We  can  give  the  following  non  rigorous  justification  for  this  fact: 
when  y^  and  y2  are  very  close  to  xn  the  data 
{Z(?c1)/  Z  (x2)  , . .  .  ,  Z  (xn)  ,  Z(y1),  Z(y2)}  is  equivalent  to 
{  Z  (x^  ,  Z(x2)  ,... 
and  z2  are  two 
are  related  to  |z 
the  data  are  also 
Zz  (xn^  '  and  finallY  to  f  Z  (x1)  ,  Z  (x2)  , .  .  .  ,  Z  (xR)  ,  Z  (Zj^)  ,  Z  (z2)  } 

In  the  design  of  networks  used  to  monitor  smooth  random 

phenomena  like,  for  instance,  barometric  pressure,  or  variation  of 

temperature  over  an  area  in  high  altitude,  or  used  to  estimate 

smooth  geological  random  fields,  the  discontinuity  of 

s(x;  x^,x2, . . . ,xn,y)  and  of  its  average  t (x^ , x2 , . . . , xn ,y )  = 

j  s(x;  x1,x2, . . .  ,xn,y)dx  when  y  -*•  xn  is  of  practical  interest. 
A 

If  we  want  to  improve  an  existing  network  in  a  given  area 
the  first  idea,  if  we  are  to  use  the  criterion  t  ,  is  to  find 
the  point  y  in  A  minimizing  t (x^ ,x2 , . . . ,xn ,y)  and  build  a 
new  station  or  take  a  new  measurement  there. 


•Z<xn>'  2y1(xn1'  !y2(xn" 
other  points  close  to  x 


Moreover,  if  z. 


n  '  2y,  'V 


and 


K 

2 


'  (x  ),z'  (x  )\  by  a  linear  relationship;  therefore 
z  ^  n  z  2  *i  / 

equivalent  to  {  Z  (x. ), Z  (x0 ),..., Z (x  ),z'  (x  )  , 

i  z  n  z  i  n 
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However,  we  can  generally  do  better  in  terms  of  the  same 
criterion  by  taking,  at  each  already  existing  stations,  three 
measurements  close  to  each  other  and  forming  an  angle.  This 
would  require  only  some  minor  modification  in  the  routine  of 
taking  measurements  at  stations,  and  would  altogether  cost  much 
less  money  than  to  build  a  new  station. 
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